Learning to Select Pre-Trained Deep Representations with Bayesian Evidence Framework

We propose a Bayesian evidence framework to facilitate transfer learning from pre-trained deep convolutional neural networks (CNNs). Our framework is formulated on top of a least squares SVM (LS-SVM) classifier, which is simple and fast in both training and testing, and achieves competitive performance in practice. The regularization parameters in LS-SVM is estimated automatically without grid search and cross-validation by maximizing evidence, which is a useful measure to select the best performing CNN out of multiple candidates for transfer learning; the evidence is optimized efficiently by employing Aitken's delta-squared process, which accelerates convergence of fixed point update. The proposed Bayesian evidence framework also provides a good solution to identify the best ensemble of heterogeneous CNNs through a greedy algorithm. Our Bayesian evidence framework for transfer learning is tested on 12 visual recognition datasets and illustrates the state-of-the-art performance consistently in terms of prediction accuracy and modeling efficiency.Comment: Appearing in CVPR-2016 (oral presentation

Readmissions following elective radical total gastrectomy for early gastric cancer: A case-controlled study

AbstractBackgroundReadmission after gastrectomy is one of the factors that reflect quality of life. Therefore, we analyzed the several factors related to readmissions after total gastrectomy for early gastric cancer.MethodsFrom January 2002 through December 2009, 102 consecutive patients who underwent radical total gastrectomy for early gastric cancer were enrolled in this study. We evaluated the incidence, cause, time point, and type of treatment for readmission after discharge; we compared the readmission and non-readmission groups in regard to clinicopathologic features and postoperative outcomes.ResultsThe readmission rate during the five years after total gastrectomy was 22 of 102 (21.6%). The most common cause for readmission was esophagojejunostomy stricture (5 cases). The treatment given for 31 readmissions included 23 conservative therapies, 3 radiologic or endoscopic interventions, and 5 re-operations. No significant differences were detected in the clinicopathologic feature, postoperative outcomes, or 5-year survival rates between the readmission and non-readmission group. No specific risk factor was found to be associated with readmission.ConclusionAlthough we could not determine a specific risk factor associated with readmission after radical total gastrectomy, prevention of readmission by evaluating the causes and treatments after radical total gastrectomy can improve the patient's quality of life

Modeling the Resource Requirements of Convolutional Neural Networks on Mobile Devices

Convolutional Neural Networks (CNNs) have revolutionized the research in computer vision, due to their ability to capture complex patterns, resulting in high inference accuracies. However, the increasingly complex nature of these neural networks means that they are particularly suited for server computers with powerful GPUs. We envision that deep learning applications will be eventually and widely deployed on mobile devices, e.g., smartphones, self-driving cars, and drones. Therefore, in this paper, we aim to understand the resource requirements (time, memory) of CNNs on mobile devices. First, by deploying several popular CNNs on mobile CPUs and GPUs, we measure and analyze the performance and resource usage for every layer of the CNNs. Our findings point out the potential ways of optimizing the performance on mobile devices. Second, we model the resource requirements of the different CNN computations. Finally, based on the measurement, pro ling, and modeling, we build and evaluate our modeling tool, Augur, which takes a CNN configuration (descriptor) as the input and estimates the compute time and resource usage of the CNN, to give insights about whether and how e ciently a CNN can be run on a given mobile platform. In doing so Augur tackles several challenges: (i) how to overcome pro ling and measurement overhead; (ii) how to capture the variance in different mobile platforms with different processors, memory, and cache sizes; and (iii) how to account for the variance in the number, type and size of layers of the different CNN configurations

Evidence for the Existence of Secretory Granule (Dense-Core Vesicle)-Based Inositol 1,4,5-Trisphosphate-Dependent Ca2+ Signaling System in Astrocytes

BACKGROUND: The gliotransmitters released from astrocytes are deemed to play key roles in the glial cell-neuron communication for normal function of the brain. The gliotransmitters, such as glutamate, ATP, D-serine, neuropeptide Y, are stored in vesicles of astrocytes and secreted following the inositol 1,4,5-trisphosphate (IP3)-induced intracellular Ca2+ releases. Yet studies on the identity of the IP3-dependent intracellular Ca2+ stores remain virtually unexplored. PRINCIPAL FINDINGS: We have therefore studied the potential existence of the IP3-sensitive intracellular Ca2+ stores in the cytoplasm of astrocytes using human brain tissue samples in contrast to cultured astrocytes that had primarily been used in the past. It was thus found that secretory granule marker proteins chromogranins and secretogranin II localize in the large dense core vesicles of astrocytes, thereby confirming the large dense core vesicles as bona fide secretory granules. Moreover, consistent with the major IP3-dependent intracellular Ca2+ store role of secretory granules in secretory cells, secretory granules of astrocytes also contained all three (types 1, 2, and 3) IP3R isoforms. SIGNIFICANCE: Given that the secretory granule marker proteins chromogranins and secretogranin II are high-capacity, low-affinity Ca2+ storage proteins and chromogranins interact with the IP3Rs to activate the IP3R/Ca2+ channels, i.e., increase both the mean open time and the open probability of the channels, these results imply that secretory granules of astrocytes function as the IP3-sensitive intracellular Ca2+ store

Creep and Oxidation Behaviors of Alloy 617 in Air and Helium Environments at 1173K

AbstractCreep and oxidation behaviours of Alloy 617 in air and helium (He) environments at 1173K were comparatively investigated under different applied stress levels. There were no large differences in the shapes of the creep curves between the air and He environments. Creep rupture time in the He environment was shorter than that in air. The outer Cr-oxide thickness of the air specimens was thicker in short-tested duration than that of the He specimens. However, in the long- tested duration over 3,000h, the Cr-oxide thickness in the He environment was larger than in air. It was found that creep rupture life was closely related to the thickness of the outer Cr-oxide layer, because the form of the outer Cr-rich oxide layer brings about the Cr-depleted region which may deteriorate material strength or creep life

Institutional Change and Continuity in Koreas Central Agencies, 1948-2011

This article analyzes Koreas central agencies, which have been organized and reorganized to support presidential executive leadership since the foundation of the Republic. Each central agency has carried out the standardization of a core administrative function which is essential to the operation of administrative apparatuses, including policy planning and coordination, budgeting, organizing, staffing, legislation, public relations, central-local relations, control and performance evaluation, etc. The six decades of institutionalization can be characterized, based on the central agencies proportion of the total administrative apparatus, into three phases: high (more than 35 percent, 1948-1961), middle (around 20 percent, 1962-2007), and low (about 10 percent, 2008-present). Regardless of the changing size and organizational configuration of the central agencies, however, their roles and influence as core executive apparatuses have remained largely unchanged, especially since the early 1960s. More than 67 percent, on average, of the heads and deputy heads of CAs have been former public servants, less than 18 percent have been former politicians, and about 15percent have been former outside experts. This strong bureaucratic background has oriented Koreas core executive policy direction significantly toward longterm, consistent, and plan rationality rather than short-term, flexible, and democratic responsiveness

Influence of oxygen vacancy on the electronic structure of HfO2_2 film

We investigated the unoccupied part of the electronic structure of the oxygen-deficient hafnium oxide (HfO$_{\sim1.8}$) using soft x-ray absorption spectroscopy at O $K$ and Hf $N_3$ edges. Band-tail states beneath the unoccupied Hf 5$d$ band are observed in the O $K$-edge spectra; combined with ultraviolet photoemission spectrum, this indicates the non-negligible occupation of Hf 5$d$ state. However, Hf $N_3$-edge magnetic circular dichroism spectrum reveals the absence of a long-range ferromagnetic spin order in the oxide. Thus the small amount of $d$ electron gained by the vacancy formation does not show inter-site correlation, contrary to a recent report [M. Venkatesan {\it et al.}, Nature {\bf 430}, 630 (2004)].Comment: 5 pages, 4 figures, submitted to Phys. Rev.